Probability-Based Dynamic Time Warping for Gesture Recognition on RGB-D Data
نویسندگان
چکیده
Dynamic Time Warping (DTW) is commonly used in gesture recognition tasks in order to tackle the temporal length variability of gestures. In the DTW framework, a set of gesture patterns are compared one by one to a maybe infinite test sequence, and a query gesture category is recognized if a warping cost inferior to a given value is found within the test sequence. Nevertheless, either taking one single sample per gesture category or a set of isolated samples may not encode the variability of such gesture category. In this paper, a probability-based DTW for gesture recognition is proposed. Different samples of the same gesture pattern obtained from RGB-Depth data are used to build a Gaussian-based probabilistic model of the gesture. Finally, the cost of DTW has been adapted accordingly to the new model. The proposed approach is tested in a challenging scenario, showing better performance of the probability-based DTW in comparison to state-of-the-art approaches for gesture recognition on RGB-D data.
منابع مشابه
Probability-based Dynamic Time Warping and Bag-of-Visual-and-Depth-Words for Human Gesture Recognition in RGB-D
We present a methodology to address the problem of human gesture segmentation and recognition in video and depth image sequences. A Bag-ofVisual-and-Depth-Words (BoVDW) model is introduced as an extension of the Bag-of-Visual-Words (BoVW) model. State-of-the-art RGB and depth features, including a newly proposed depth descriptor, are analysed and combined in a late fusion form. The method is in...
متن کاملHand Gesture Recognition from RGB-D Data using 2D and 3D Convolutional Neural Networks: a comparative study
Despite considerable enhances in recognizing hand gestures from still images, there are still many challenges in the classification of hand gestures in videos. The latter comes with more challenges, including higher computational complexity and arduous task of representing temporal features. Hand movement dynamics, represented by temporal features, have to be extracted by analyzing the total fr...
متن کاملSequence Alignment for RGB-D and Motion Capture Skeletons
RGB-D skeletons are nowadays commonly used e.g. for gesture recognition, and so their accuracy and stability have significant influence on further processing. Skeletons obtained with motion capture are considerably more accurate and can be used to assess the quality of RGB-D skeleton extraction algorithms. In this paper, we record motion sequences with both a Kinect RGB-D sensor and a full moti...
متن کاملGesture-based user interface for SmartWalker
In this work, a novel gesture recognition system is presented that allows the control of the SmartWalker by performing simple gestures. The SmartWalker is a normal walker equipped with sensors and actuators that can move autonomously. It is constructed as a walking aid for elderly people. Therefore our gesture recognition system is developed for the same target group which means that gestures w...
متن کاملRobot Arm Performing Writing through Speech Recognition Using Dynamic Time Warping Algorithm
This paper aims to develop a writing robot by recognizing the speech signal from the user. The robot arm constructed mainly for the disabled people who can’t perform writing on their own. Here, dynamic time warping (DTW) algorithm is used to recognize the speech signal from the user. The action performed by the robot arm in the environment is done by reducing the redundancy which frequently fac...
متن کامل